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CLAIMS: 

1. A system and method for directing post-processing to improve picture 
quality of a decoded digital video signal encoded as a sequence of at least one frame of 
block-based data, said system comprising: 

a metric calculation unit for calculating a unified metric for digital video processing 
5 (UMDVP) for each pixel in the frame in accordance with a frame type to produce a 
UMDVP metric map, wherein the calculation unit comprises: 

a module that defines local spatial features in the frame, 
means for estimating block-based motion as one of a motion vector for the 
block of pixels and as at least one motion vector for the frame, 
10 a module that detects a scene change in the frame, 

means for scaling for the UMDVP metric map to align with the resolution 
of the decoded video when the UMDVP metric map does not align with the 
resolution of the decoded video, and 

means for interpolating the value of UMDVP when the position pointed at 
15 by the motion vector does not co-site with a pixel; and 

a post-processing unit having at least one quality improvement algorithm, 
wherein, said calculation unit produces a scaled and interpolated UMDVP metric map for 
the frame, said post-processing unit directs said at least one quality improvement algorithm 
to improve quality of a decoded version of the digital video signal based on the UMDVP 
20 metric map, said at least one quality improvement algorithm improves the quality of the 
decoded version of the digital video based on the UMDVP metric map, and said at least 
one quality improvement algorithm is selected from the group consisting of enhancement 
algorithms and artifact reduction algorithms. 

25 2. The system of claim 1 , wherein the calculation unit further comprises a module that 
analyzes macroblock and block-based coding information according to the formula: 

num^bits _ q OFFSET 
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UMDVP(ij) = 0 for num_bits = 0 

wherein, UMDVP(ij) e [l -l] is a metric for a pixel(ij) of a block of pixel data, qLScale is 
a quantization scale for the macroblock, numj>its is a number of bits to encode a 
luminance block, and Q_OFFSET is an experimentally pre-determined value. 

5 

3. The system of claim 2, wherein: 

if the calculation unit determines that the frame is an I frame type and the module 
that detects a scene change determines that a scene change has not occurred then 
refinements are to the calculated value of UMDVP as follows: 
L 0 the calculation unit employs the means for estimating block-based motion to 

obtain a motion vector (v\h') for the current block, 

if the position pointed at by the motion vector (v*,h*) does not co-site with a 
pixel, the calculation unit employs the means for interpolation to perform an 
interpolation to obtain the value of the UMDVP metric at the position pointed at by 
15 the motion vector, and the value of the UMDVP metric is adjusted using the 

equation 

UMDVP = Rix UMDVP + (1 - Ri) x UMD VP _ prev(y % , K ) 

wherein, UMDVP jprev(v',h') is the value of the UMDVP metric at the location 
pointed at by (v',h') in the previous frame and Ri is a pre-determined weighting 
2 0 factor. 



4. The system of claim 3, wherein the value of UMDVP is further adjusted and 
refined for a local spatial feature as follows: 

UMDVP(i j) = UMDVP(ij) +1 for 
25 UMDVP(ij)<0,(var(ij)>VAR^THRED) 
and 



uMDmij)=uMDmijr [ v ^^ \ 



30 



wherein, var(i j) is a variance defined for the local spatial feature and VAR_THRED is a 
pre-determined threshold that is empirically determined. 
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5. The system of claim 4, wherein the local spatial feature is an edge and the edge- 
dependent local variance is defined as: 

when pixel (i j) helongs to a horizontal edge, the edge-dependent local variance is 

defined as: 

5 var(i , j) = \pixel(i, j - 1) - mean] + \pixel(i, j) -mean] + \pixel(i, j+l)- mean] 



where mean- 



3 

when pixel (i j) helongs to a vertical edge, the edge-dependent local variance is 
defined as: 

var(i, j) -= ]pixel(i - 1, j) - mean] + \pixel(i, j) - mean] + ]pixel(i + 1, j) - mean] 



10 where mean = 



when pixel(i j) helongs to a diagonal edge, the edge-dependent local variance is 
defined as: 

var(i, j) = ]pixel(i - 1, j - 1) - mean] + ]pixel(i , j) - mean] + ]pixel(i -I, j + l)- mean] 
+ ]pixel(i + 1,7-1)- mean] + \pixel(i + 1, j + 1) - mean] 

15 where mean = 

(pixelji - 1, j '- 1) + pixelji - 1,7 + 1) + pixelji, j) + pixelji + 1, j - 1) + pixelji + 1J + 1)) 

5 

when pixel(i j) does not belong to any of the aforementioned edges, the variance is 
defined as: 

var(i,j) = 2 + P*J + V) " mean \ 



Yj^pixel{i + p y j + q)\ 

V p=-Igo-l J 

20 where mean = 



6. The system of claim 3, wherein the value of UMDVP is further adjusted and 
refined (58) for a local spatial feature as follows: 
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UMDVP(ij) = UMDVP(ij)+l for 
UMDVP(ij)<0,(var(ij)>VAR_THILED) 

and 

VMDmiJ) = UMDVP(iJ)*[j;^^] 

5 

wherein, var(i j) is a variance defined for the local spatial feature and VARTHRED is a 
pre-determined threshold that is empirically determined. 

7. The system of claim 6, wherein the local spatial feature is and edge and the edge- 
1 0 dependent local variance is defined as: 

when pixel (i j) belongs to a horizontal edge, the edge-dependent local variance is 

defined as: 

r(i,j) = \pixel(i,j - 1) - mean] + \pixel{i,j) - mean] + \pixel(i,j + 1) - mean] 



vari 



where mean = 



1 5 when pixel (i j) belongs to a vertical edge, the edge-dependent local variance is 

defined as: 

var(i, j) = \pixel(i - 1, j) - mean] + ]pixel(i, j) - mean] + \pixel(i + 1, J) - mean] 



where mean = 



%pixel(i + qj)\ 



3 



2 0 when pixel(i j) belongs to a diagonal edge, the edge-dependent local variance is 

defined as: 

var(i,j) = \pixel{i - 1J -l)-mean\+\pixel(i,j) - mean] + \pixel(i - l,j + 1) - mean] 
+ \pixel(i + 1J-V)- mean] + \pixel(i + 1 J + 1) - mean] 

where mean = 

(pixeld - 1, j - 1) + pixeiq + pixelji, j) + pixelji + 1, j - 1) + p ixelji + 1 J + 1)) 
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when pixel(ij) does not belong to any of the aforementioned edges, the variance is 



defined as: 




\p~-lq=-\ J 

mean = 




5 

8. The system of claim 2, wherein: 

if the calculation unit determines that the frame is one of a P or B frame type then: 



if the module that detects a scene change determines that a scene change has 
not occurred or the condition {{Intra -block) and {numjyits *0)) is not 
satisfied then refinements are made to the calculated value of UMDVP as 
follows- 

a. the calculation module employs the means for motion estimation 
to calculate a motion vector (v',h') for the current block, 

b. if the position pointed at by (v\h') does not co-site with a pixel, 
the calculation unit employs the means for interpolation to perform 
an interpolation to obtain the value of the UMDVP metric at the 
position point at by the motion vector, and 

c. the value of the UMDVP metric is set as follows 
UMDVP = UMDVP_prev(v'h 5 ) 



2 0 wherein UMDVP _prev(v\h') is the value of the UMDVP metric at the location pointed at 
by (v\h*) in the previous frame. 

9. The system of claim 8, wherein the value of UMDVP is further adjusted and 
refined for a local spatial feature as follows: 



25 



UMDVP(ij) - UMDVP(ij) +1 
XJMDVP(ij)<0,(var(ij)>VAR_THRED) 



for 



and 
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wherein, var(i j) is a variance defined for the local spatial feature and VAR.THRED is a 
pre-determined threshold that is empirically determined. 

10. The system of claim 9, wherein the local spatial feature is an edge and the edge- 
5 dependent local variance is defined as: 

when pixel (i j) belongs to a horizontal edge, the edge-dependent local variance is 

defined as: 

var(i, j) = \pixel(i, j-V)- mean] + \pixel(i, j) - mean] + \pixel (i, j + 1) - mean\ 



i 



where mean = 



^pixeliij + q) 



3 

1 o when pixel (i j) belongs to a vertical edge, the edge-dependent local variance is 

defined as: 

var{i, j) = \pixel(i - 1, j) - mean] + \pixel(i, j) - mean] + ]pixel(i + 1, j) - mean] 



where mean = 



j^pixeHi + qJ)] 



1 5 when pixel(i j) belongs to a diagonal edge, the edge-dependent local variance is 

defined as: 

var (i t j) = \pixel(i -1,7-1)- mean] + ]pixel(i, j) - mean] + ]pixel(i - 1, j + 1) - mean] 



+ 



]pixel(i + l,j - 1) - mean] + ]pixel(i + 1,7+1)- mean] 



where mean = 

( pixeld - 1, j - 1) + pixelQ -1,7 + 1) + ptcdjU j) + P^elji + 1, j - 1) + pixe lji + 1, 7 + 1)) 

. ■ - 

2 0 when pixel(i j) does not belong to any of the aforementioned edges, the variance is 

defined as: 

var(i,f) = 2 ilP^C + P>J + 9) ~ ™ 



where mean = 



fiii*prf('+p.y+«)| 
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1 1 . The system of claim 1 , wherein the enhancement algorithm is a sharpness 
enhancement algorithm comprising one of peaking and transient improvement. 

12. The system of claim 1 1 , wherein: 
the sharpness enhancement algorithm is a peaking algorithm; and 
the UMDVP metric is adjusted as follows before applying it to the output of the 

peaking algorithm 

r UMDVP UMDVP < 0.3 

UMDVP = v UMDVP + 0.5 when 0.3 < UMDVP < 0.5 
| 1.0 UMDVP ^ 0.5 

13. The system of claim 12, wherein the output of the peaking algorithm is controlled 
by the technique of coring and the UMDVP metric is applied to the output of the coring 
technique. 

15 14. A method for directing post-processing to improve picture quality of a decoded 
digital video signal, said system comprising: 

providing a module that defines local spatial features in the frame; 

providing means for estimating block-based motion vectors for the frame; 

providing a module that detects a scene change in the frame; 
20 providing means for interpolating the UMDVP metric if the location pointed at by 

the 

motion vector does not co-site with a pixel; 

calculating a unified metric UMDVP for digital video processing (UMDVP) for 
each pixel in the frame based on frame type, local spatial feature, block-based motion 
2 5 estimation, and detected scene changes; 

producing a UMDVP metric map of the calculated UMDVP metric for each pixel; 

if the UMDVP metric map does not align with the resolution of the decoded signal, 
scaling the metric map to align the UMDVP metric map with the resolution of the decoded 
signal; and 
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post-processing the frame by applying the UMDVP metric map to direct the 
selection and aggressiveness of at least one quality improvement algorithm selected from 
the group consisting of enhancement algorithms and artifact reduction algorithms. 

15. The method of claim 14, wherein the calculating step further comprises the step of 
analyzing macroblock and block-based coding information and calculating the UMDVP 
metric according to the formula: 



num_bits _ Q OFFSET 
UMDVPUJ)- 9 - SC Q e _ OFFSET #0 



UMDVP(ij) = 0 for numbits = 0 

wherein, UMDVP(ij) e [l,-l] is a metric for a pixel(ij) of a block of pixel data, q_scale is 
a quantization scale for the macroblock, num_bits is a number of bits to encode a 
luminance block, and Q_OFFSET is an experimentally predetermined value. 

16. The method of claim 15, further comprising the steps of: 
determining that the frame is an I frame type; 

if a scene change has not been detected and the frame has been determined to be an 
I frame type, estimating a motion vector (v',h') for the current block by the means for 
estimating; 

if the position pointed at by the motion vector (v',h') does not co-site with a pixel, 
performing an interpolation to obtain the value of the UMDVP metric at the position 
pointed at by the motion vector (v',h') by the means for interpolating; and 

adjusting the value of the UMDVP metric using the equation 

UMDVP = RixUMDVP + (1 - Ri) x UMDVP _prev(v',h') 

wherein, UMDVP _prev(v\h') is the value of the UMDVP metric at the location 
pointed at by (v'^') in the previous frame and Ri is a predetermined weighting factor. 

17. The method of claim 16, further comprising the steps of: 

adjusting the value of UMDVP for a local spatial feature as follows: 
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UMDVP(ij) = UMDVP(ij) +1 
UMDW(U)<OXvar(ij)>VAR_THRED) 



for 



and 



5 UMDVP(i,j) = UMDVPQJ) * 



varQj) 



VAR THRED 



wherein, var(ij) is a variance defined for the local spatial feature and VAR_THRED is a 



pre-determined threshold that is empirically determined. 

10 18. The method of claim 1 7, further comprising the steps of: 

if the local spatial feature is an edge, calculating the edge-dependent local variance 
is defined as: 

when pixel (i j) belongs to a horizontal edge, the edge-dependent local variance is 
defined as: 

15 var(i,J) = ]pixel(iJ-\)-mean\ + ]pixel{iJ)-mean] + ]pixel(iJ + \)-mean] 



where mean = — 

when pixel (i j) belongs to a vertical edge, the edge-dependent local variance is 




defined as: 



var(i, j) = ]pixel(i - 1, j) - mean] + \pixel(i, j) - mean] 



i| + ]pixel(i + 1,./) - mean] 



20 




when pixel(i j) belongs to a diagonal edge, the edge-dependent local variance is 



defined as: 



var(i, j) = ]pixel(i - 1, j - 1) - mean] + \pixel(i, j) - mean] + ]pixel(i - 1, j + 1) - mean] 
+ ]pixel(i + 1,7-1)- mean] +\pixel(i + 1,7 + 1) - mean] 
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(pixel(i - 1, j - 1) + pixelji - 1, j + 1) + pixel(i 9 j) + pixelji + 1, 7 - 1) + pixel g + W + 1)) 

5 

when pixel(i j) does not belong to any of the aforementioned edges, the variance is 



defined as: 



5 



where mean = 




10 



1 9. The method of claim 1 5, further comprising the steps of: 
determining that the frame is one of a P or B frame type; 
if a scene change has not been detected or the condition 



((Intra - block ) and (nam _ bits * 0)) 



is not satisfied, estimating a motion vector (v\h') for the current block by the means for 
estimating; 

if the position pointed at by the motion vector (v',h') does not co-site with a pixel, 
15 obtaining the value of the UMDVP metric at the position pointed by the motion vector 
(v\h') by the means for interpolating; and 



wherein, UMDVT_prev(v',h') is the value of the UMDVP metric at the location pointed at 
20 by (v' Ji*) in the previous frame. 

20. The method of claim 19, further comprising the steps of: 



adjusting the value of the UMDVP metric using the equation 
UMDVP = UMDVP jprev(v'h'), 



adjusting the value of UMDVP for a local spatial feature as follows: 
UMDVP(i j) = UMDVP(i j) +1 for 
25 UMDW(y)<0,(var(ij)>VAR^THRED) 



and 
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wherein, vai(i j) is a variance defined for the local spatial feature and VARTHRED is a 
pre-determined threshold that is empirically determined. 

21 . The method of claim 20, further comprising the steps of: 
5 if the local spatial feature is an edge, calculating the edge-dependent local variance 

as: 

when pixel (i j) belongs to a horizontal edge, the edge-dependent local variance is 
defined as: 

var (i 9 j) = \pixel(i 9 j - 1) - mea?\ + \pixel (i 9 j) - mean\ + \pixel(i , j + 1) - mean] 



10 where mean = ^ 

when pixel (i j) belongs to a vertical edge, the edge-dependent local variance is 
defined as: 

var(i, j) = \pixel(i - 1, j) - mean] + |/rfxe/(f, j) - + |/>£xe/(i + 1, j) - 



£/tt*e/(z + £»7) 1 
V9=-i 7 



where , 

15 

when pixel(i j) belongs to a diagonal edge, the edge-dependent local variance is 
defined as: 

var(i 9 j) = \pixel(i - 1, j - 1) - weaw| + jjpixe/C* , j) - wean| + j pixel(i -1,7 + 1)- mean) 
+ |p£«?/(z + 1, 7 - 1) - mean] + jpixe/Cz + 1, j + 1) - mean\ 

where mean = 

(pfae/Q' - 1, 7 - 1) + pixelji - 1, 7 + 1) ± pixel(i 9 7) + pixelji + 1, 7 - 1) + pixelji + 1, 7 + 1)) 
20 5 

when pixel(ij) does not belong to any of the aforementioned edges, the variance is 
defined as: 

1 



where mean = 



\p=-lq~-l 7 
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22. The method of claim 14, wherein the enhancement algorithm is a sharpness 
enhancement algorithm comprising one of peaking and transient improvement. 

23. The method of claim 22, wherein: 

the sharpness enhancement algorithm is a peaking algorithm; and 
further comprising the step of adjusting the UMDVP metric as follows hefore 
applying it to the output of the peaking algorithm 



UMDVP = < 



UMDVP 
UMDVP + 0.5 
1.0 



when 



UMDVP £0.3 
03<UMDVP<0.5 
UMDVP > 0.5 



24. 



The method of claim 23, further comprising the steps of : 

controlling the output of the peaking algorithm by the technique of coring; and 

applying the UMDVP metric the output of the coring technique. 



